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(54) Method and device to establish viewing zones and to inspect products using viewing zones 



(57) In a device used to inspect substrates visually, 
an imaging region and a magnification are specified 
ahead of time for every component and stored as library 
data in a memory (23). The memory (23) also contains 
CAD data, which include the class of each component 
on the substrate and its location. During initialization, a 
control unit (22) links the location data for a component 
extracted from the CAD data to corresponding library 
data and specifies a field of view and a magnification for 
every component on the substrate. Using this data, the 



control unit (22) creates on the substrate a number of 
viewing zones to be inspected at various magnif ications 
and stores the data specifying these zones in the mem- 
ory (23). When a substrate is to be inspected, the control 
unit (22) uses the data specifying these zones to control 
the position and magnification of an imaging unit (2) to 
collect image data from each zone successively and dis- 
play them on a monitor (6). 
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comln °S: n USefU ' to inspect soldered portion of 
components mounted on a substrate, such asTorinted 

substrate that is then used to evaluate the attachment of 

TT^^ e ^^^ Ualwa ^^''nspSn 
'" specb on devices establish multiple viewing 
zones on the substrate prior to inspection. Thereafter^ 

ZlZt^* mwed ™^ «° - "vSing 
,^^0 r 9e ' SC ^ Uredforeach20ne - Foravisual 
Ston^ 9 ^ 31 h3Ve b6en ^ured for S 
STL^ 0,1 3 monitor ^ evaluated by 
e^Z S F ° r a " aUt0mat,c Section, a control uS 
extracts the .mage data representing the portion of the 
zone tobe inspected and compares^ M 

.i S h^w^ n9 T e0fthetypedescribedab °veisestab- 
hshed for every .ocation on the substrate where a com- 

Pri ° rtotheins P^°n, a control 

each ™^ ' Ce ' S PrOVided P 05 ^" for 
oSnS^ rt ' USI " 9 Sither imaaes have been 
obtained by imaging a substrate on which all the compo- 
se JZT LT med ° r ~™er-aided^£n 
Lb^i1^f ea, ^ dU : in9 ^ epwessofdesi 9™n9the 
substrate. The pos.tion data are generally in the form of 
coordinates of specific reference points such asZ 
center point of each component. * 

^ ta S' h 22A ShOWS an examp,e of the P^ess used to 
establish a viewing zone. An imaging region R wWch 

desponds to the field of view of th^^^ 
speof-ed in the image data representing an LcTpLble 
substrate or in the CAD data. The imaging region R 
thenscannedsuccessivelythrough the date 
minhth 226 Sh ° WS 30 examp,e 01 h ow components 

Xno aTeS ** ima9in9 re ^» ™* 
f ™ 9 ' Venf,cat,on re g'on 50 is used to judge whether 
a component is retained within imaging region H^l 

SE^? 1 ? " SPeCif ' ed by te ^ whtehle a 
dSeTmltZ 6 ,m39in9 re9i ° n R - The control unft 
determines that a component lies within imaging region 

The control unit scans imaging reoion R 

heposjionsand the total numberofcente S£3S 
the vesication region 50. A verification region OTcon 

ESJSZT* ° f °" e ° r cominenSS 
tne posrt-on of an .maging region R. The imaging region 
defined by this process is stored in the merZ ? s a 
viewing zone. When the center point of every covert 

ess of establ.sh.ng the viewing zones is completed 

coin telf t 6XamPle ShtWn R 9- 22B. the center 

pornts of four components (51. 52. 53 and 54) are oon- 



St£rJ2?*£ re9i0n *• * this *** 1,16 control 
unrt woukf define the position of an imaging region R 
The location and size of this region R woukl be stored 

5 tied as the rtems to be inspected in this viewing zone. 
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w rati^T e °° 0rdina1es ° ,lr| e referencepoint indi- 

ssses: * each component and «^«2n 

do^ 1 ^ e ^P^ent which is to be inspected 

e?en^fr ,y °°' ncWB " " SOmetimes »»PP« mat 
even though a component s reference point lies within 
me v.ew,ng zone, the portion to be inspected doeTnot 
^nTSV^r ^ ~" is d -- asThoSi 
laVL £ A P ° rt,0nS 55 ° f °° m P°^nts 51 and 52 
*at are to be inspected lie within the viewing zone It is 
thus possible to inspect these component ml 
zone. Some of me portions 56 tobeTr^ed ^ ^ 
20 ponente « end 54. however, lie outeWelS^Tg 
zone and cannot be inspected using this zone 9 

chec£d°aii e tT iSPf0b,em - each vi ewingzonemustbe 
necked after me zones are established. If any portion 

^e^mponentthatistobeir^edfenotinthe^ 
^" e ^ere mat component is .ocated. me 
of that zone must be corrected or the entire zonTmutf 

.nLST S ° tha * a " P"* 0 " 8 0f components tobJ 
^pected are portioned in some viewing zone. SigrtifT 
cant time and effort is required to check each vteK, 

as me number of zones increases. 

The invention permits viewing zones to be estaH. 

established for each class of component ananas rvf» 
« substrate and mat identify the KTl£E£S£ 

imnr^ e I ,CienCyand accuracvof •» inspection is also 
40 h y , US ' n9 3 P rede,ine d magnification value for 
fo fi^° ,M ^ nem,os « ,hed esiredn,agnrficatiS 

Stinl7 m T nent ° n the Substrate " Thereafter, me 
optimal magnrfication is set for each component^ 
e^ab.ish.ng m e viewing zones using data e^fnJtS 

m J"°" e a ^ generally, me invention features a 
method of establishing a number of viewing zones for 
usern inspecting the attachment of a numbef 2££ 

°l^* f0f ® a f component on me object are defined by 
Z on Z « repr6Sentin 9 th « 'ocation of the conpo^ 
for me cTif ^ ^ ^ identifyin9 the f ield of ^ew 
Sonos S^, COmPOnent 10 • M * the component 
55 fcS35i!SS V,eWm9 Z0n6S are created on «ne sur- 
5S2l 1 US ' nS me f ie,ds of wew ** ha "e been 

a mi,^?^ 3 !? 60 *- 9enera,ly - the Mention features 

K Shin9 ViSWin9 2 ° nes in whf ch f ieldsS 
v.ew are defined by combining, for each component on 
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the object data representing the location of that compo- 
nent on the object with data concerning the field of view 
and the magnification to be used for the class of compo- 
nents to which that component belongs. Thereafter, 
viewing zones are created on the surface of the object 
using the field of view and the magnifications which have 
been defined. 

The invention also features a device that impl ements 
the methods for establishing viewing zones. The device 
may include a memory that records data concerning a 
field of view needed to inspect each of a number of 
classes of components, an input device that supplies 
data representing the class of each component on the 
object and its location on the object, and a controller that 
receives data from the input device, combines this data 
with the data from the memory to define a field of view 
for each component on the object, and uses the fields of 
view to establish viewing zones on the object. 

According to the invention, a number of viewing 
zones may be established for the purpose of inspecting 
the attachment of each component on an object having 
multiple components positioned on it. Data representing 
the location of each component on the object are linked 
to data defining a field of view which were previously 
recorded for the relevant class of component. In this way. 
a field of view is defined for every component on the 
object. Because these fields of view are used to create 
viewing zones, the portions of each component that are 
to be inspected will necessarily be assigned to one of 
the viewing zones created, and no processing will be 
needed to modify or enlarge a viewing zone. This 
improves the efficiency of the processing involved in set- 
ting up the viewing zones. Also, since the correct number 
of zones is created for inspection, the efficiency of the 
inspection itself is substantially enhanced. 

Data representing the location of each component 
on the substrate may be linked to data representing the 
field of view and the magnification which have been 
specified for the class to which that component belongs. 
In this way the appropriate field of view can be specified 
according to the location of the component, and a mag- 
nification appropriate for that class of component can be 
specified. These data can then be used to create viewing 
zones. During inspection of a substrate, the position of 
the imaging device and its magnification can be control- 
I ed according to the data specified for each viewi ng zone. 
Optimal image data are obtained for each component, 
and efficiency and accuracy are substantially enhanced. 

Design data originally created to arrange each com- 
ponent on the object may be entered to specify the dass 
to which each component belongs and its relative loca- 
tion on the object Also, design data may be entered to 
identify each component and specify its relative location 
on the object Use of design data allows data input to be 
executed accurately and swiftly, which in turn allows 
viewing zones to be created accurately and swiftly. 

The location of each viewing zone is adjusted so that 
the center point of that viewing zone matches the center 
point of a rectangular region which includes every field 



of view which lies within that zone. This causes all fields 
of view to be placed in a viewing zone in a balanced fash- 
ion and guarantees that the display screen will be easy 
to read during inspection. 

Marks which serve to identify the location of each 
item to be inspected in a viewing zone may be displayed 
along with the image data representing that zone. When 
the substrate is to be inspected visually, this arrange- 
ment allows the inspector to verify the locations to be 
inspected, which results in higher accuracy and effi- 
ciency. 

Other features and advantages of the invention will 
become clear from the following detailed description of 
the preferred embodiments, from the drawings, and from 
the claims. . 

Brief Description of the Drawing 

Fig. 1 is a perspective view of an inspection device. 

Fig. 2 is a block diagram of the electrical configura- 
tion of the inspection device of Fig. 1 . 

Figs. 3 A-3C provide examples of how the data defin- 
ing a field of view might be selected. 

Fig. 4 illustrates how data are configured in the 
memory. 

Fig. 5 illustrates data in a CAD data file. 

Fig. 6 illustrates data in a data file providing part 
number correspondence. 

Fig. 7 illustrates data in a library data file. 

Fig. 8 shows an example of viewing zone selection. 

Fig. 9 is a flowchart of a procedure by which library 
data are compiled. 

Figs. 10A-10B show monitor displays when library 
data are being compiled. 

Fig. 1 1 is a flowchart of a procedure by which data 
are loaded and viewing zones are selected. 

Fig. 1 2 is a flowchart showing details of how viewing 
zones are selected in the procedure of Fig. 1 1 . 

Figs. 1 3A-1 3D illustrate an example of how the loca- 
tion of a viewing zone is adjusted. 

Hg. 1 4 shows a final position adjustment performed 
on an imaging zone. 

Figs. 1 5 and 16 are flowcharts of an inspection pro- 
cedure. 

Figs. 17-19 show examples of monitor displays dur- 
ing an inspection. 

Hg. 20 is a perspective view of a machine for storing 
data. 

Fig. 21 is a block diagram of the electrical configu- 
ration of the machine of Fig. 20. 

Figs. 22A and 22B illustrate a method for setting up 
viewing zones. 

Pescription of the Preferred Embodiments 

Fig. 1 illustrates an inspection device used by an 
inspector who visually evaluates the quality of the mount- 
ing of each component on a printed substrate. The 
device includes a stage unit 1, an imaging unit 2, a light 
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unit 3, a controller 4, a substrate stage 5, a monitor 6 
and an input unit 7. 

The stage unit 1 includes a box-shaped housing 1 1 
with a rectangular opening 1 2 located on its front surface 
Housmgll sits on baseboard 10. Controller 4 and mon- 
itor 6 are positioned on top of housing 1 1. Imaging unit 
2 and light unit 3, which constitute a single entity, are 
mounted above the opening 12. 

A color video camera is located in the imaging unit 
2 along with an optical system having a zoom lens with 
manually adjustable magnification. Light unit 3 Includes 
annular light sources 17, 18 and 19 (Fig. 2) that emit, 
respectively, red, green and blue light and are shielded 
by a hood. Imaging unit 2 and light unit 3 are connected 
to an X-axis table 20 in housing 1 1 (see Fig. 2) and travel 
along the X axis, which is indicated in Fig. 1 as direction 
A. 

Substrate stage 5 includes a Y-axis table 8 that is 
connected to baseboard 10 in such a way that it can 
travel along the Y axis, which is indicated in Fig i as 
direction B. Substrate stage 5 also includes substrate 
supports 9a and 9b, which are fixed to the top of Y-axis 
table 8. 

When an inspection is performed, the substrate to 
be inspected is held in place by supports 9a and 9b 
When the inspector indicates that the inspection should 
be executed, the imaging unit 2 and light unit 3 move 
along the X axis, while the substrate stage 5 moves along 
the Y axis. The viewing zones on the substrate are 
imaged, and the image data are supplied to controller 4 
The inspector judges the quality of every portion to be 
inspected by referring to images displayed on monitor 6. 

The controller 4 includes a floppy disk drive 21 
which reads CAD data or data representing the class of 
each component and stores them in an internal memory. 
Prior to inspection, controller 4 uses the data to establish 
viewing zones on the substrate to be inspected. 

Input unit 7 includes keyboards 14 and 15 and 
mouse 16. Prior to the inspection, the inspector enters 
all necessary data via large keyboard 1 4 and mouse 1 6 
During an inspection, the operator uses small keyboard 
1 5 to execute the processing, to move to the next viewing 
zone, to indicate the portion to be inspected, and to enter 
the result of the quality judgment. 

In addition to displaying the image captured by imag- 
ing unit 2, monitor 6 displays screens facilitating data 
input during initialization and showing the result of the 
inspection. 

Fig. 2 shows the electrical configuration of the 
inspection device. The controller 4 includes control unit 
22, memory 23. image controller 24 and XY table con- 
troller 25. 

Image controller 24 has an interface that connects 
control unit 22 with imaging unit 2 and light unit 3 
Through this interface, control unit 22 controls the quan- 
tity of light emitted by each of light sources 17. 18 and 
19. along with the interactive balance of each color of 
light received by imaging unit 2. 



The X-axis table 20 and Y-axis table 8 each have a 
drive mechanism (not shown). One drive mechanisms 
causes X-axis table 20 to move imaging unit 2 and light 
unit 3 along the X axis, while the other causes Y-axis 
s table 8 to move the substrate stage 5 along the Y axis. 
XY table controller 25 has an interface which con- 
nects control unit 22 with the drive mechanisms for the 
X-axis table 20 and Y-axis table a The operation of each 
drrve mechanism is based on a command from control 
10 unit 22. By controlling the position of tables 20 and 8 
control unit 22 causes the field of view of imaging unit 2 
to coincide with a viewing zone. 

Control unit 22 has a microprocessor that reads data 
from and writes data into each of the input and output 
is units. Control unit 22 also controls all operations per- 
formed by the inspection device during initialization prior 
to inspection and during inspection. 

Memory 23 stores initialization data generated by 
control unit 22, image data representing the object to be 
so inspected, and data concerning inspection results that 
are entered via input unit 7. 

Before initialization, library data concerning the field 
of view and magnification needed to inspect each class 
of component are compiled and stored, and the CAD 
25 data which specify the class and location of each com- 
ponent on the substrate are placed in memory 23 During 
initialization, the CAD data are linked with the library data 
to verify the data associated with the location of the field 
of view and the magnification used to inspect each com- 
30 ponent on the substrate. Once verified, these data are 
used to generatedata used in establishing viewing zones 
on the substrate. 

Figs. 3A-3C show examples of how data concerning 
fields of view might be established in the library data In 
35 particular. Figs. 3A-3C are show specif ied small regions 
r containing portions of a component that are to be 
inspected are designated as component viewing zones 
A rectangular region that circumscribes all of the com- 
ponent viewing zones r for a single component is thef ield 
40 of view for that component. To define this field of view 
data are stored which represent the size of each compo- 
nent viewing zone r and its location. 

The library data displayed on the screen during 
inspection also include marks to identify the location of 
45 each portion of a component to be inspected. These 
marks, or pointers, are labeled p 1( p 2 and 03 in the exam- 
ples shown. The pointers can be placed in any location 
m a viewing zone. The shape and size of the pointers 
can be selected from an extensive menu. Data associ- 
50 ated with a chosen pointer are stored so as to correspond 
to the data which establish the viewing zone. 

Fig. 4 shows the configuration of the data associated 
with establishing viewing zones in the memory 23 This 
configuration includes CAD data file 26. which stores the 
55 CAD data; library file 27. which stores the library data- 
data file 28. which stores data corresponding to the part 
number; and data files 29 and 30. which are used in the 
inspection. Fig. 5 shows that the CAD data file 26 stores 
for every component on the substrate, the name of the 
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component its part number, the location where it is 
mounted, and the orientation at which it is mounted. The 
name given to a component permits different examples 
of a single type of component to be distinguished. For 
example, if there are three components of a type identi- s 
tied as on the substrate, the identifier W C" is used 
together with a serial number, so that the components 
are designated "C01". "C02" and "C03\ The part number 
indicates the type of component as designated by the 
manufacturer. Every component on the substrate has 
such a number. In the example shown, two of the three 
components of the type W C" (C01 and C02) have the 
same part number (CH001) while the third component 
(C03) has a different part number (CH002). The data 
which represent the location where the component is 
mounted are the X and Y coordinates of the center point 
of the component on the substrate. Data representing 
the orientation in which the component is mounted, a 
condition that is stipulated for each component are given 
in units of 90°. 

Data file 28 serves as a reference file that provides 
library data appropriate for a given part number from the 
CAD data file 26. As is shown in Fig. 6, data file 28 stores 
the class of component which corresponds to each part 
number as well as data concerning the variants. The 
class to which the component belongs refers to data that 
distinguish components with an identical shape. The var- 
iant data are codes that are used to distinguish a number 
of components belonging to the same class. In the exam- 
ple shown, the components with part numbers CH001 
and CH002 both belong to class Ci, while the compo- 
nents numbered TR001 and TR002 belong to two differ- 
ent classes (TR 1 and TR2). 

As is-shown in Fig. 7, library data file 27 stores data 
that establish a field of view and a pointer for each class 
and variant of component. Library data file 27 also iden- 
tify the optimal magnification at which to view the portion 
of the component to be inspected. The data which estab- 
lish a field of view for each class of component consist 
of data r 1p r^ etc. Each data set establishing a field of 
view consists, for example, of the coordinates defining 
the location of the upper left and lower right-hand corners 
of the field of view relative to the center point of the com- 
ponent These data would represent the location and 
size of the field of view. Pointer data pi, pa etc. indicate 
the location, type and size of the pointer created in each 
viewing zone. If all components on the substrate are 
inspected using a single magnification regardless of their 
class, only data to define the field of view and the pointer 
need be stored in library data file 27. 

The control unit 22 consults data file 28 for the part 
numbers and reads out of file 27 the library data for every 
component found in CAD data file 26. Control unit 22 
then executes processing to link the CAD and library 
data together. In this way, data are assembled to define 
the field of view, the pointer and the magnification for 
each component on the substrate. These data are stored 
in inspection data file 29. 



Control unit 22 uses the data stored for each com- 
ponent in file 29 to create data establishing a number of 
viewing zones on the substrate. Control unit 22 then 
associates the data for each viewing zone with data 
defining the field of view and pointer for each component 
contained in that zone and stores the combined data in 
file 30, a second file for inspectiontiata. 

The viewing zones, which encompass every compo- 
nent on the substrate, are drawn so that each contains 
components to be inspected at the same magnification. 
The location of each zone is adjusted so that the entire 
field of view for each component is contained in a viewing 
zone. 

Fig. 8 shows an example of how viewing zones might 
be drawn. Using data in the first inspection data file 29. 
fields of view 45 through 51 are drawn for components 
31 through 37 on the substrate. Thereafter, control unit 
22 uses a region to be imaged at a given magnification 
and scans in the structural data representing the sub- 
strate (which are generated from the CAD data). An 
imaging region is an area where all components can be 
viewed at the magnification value stipulated for that 
region. The imaging region is then specified as a viewing 
zone. Its location, the magnification it requires, and the 
various data characterizing the components contained 
in it are linked together and stored in inspection data file 
30. 

In the example shown in Fig. 8, the same magnifi- 
cation (e.g., 1x) is stipulated for components 31, 32, 33, 
35, 36 and 37, while a different magnification (e.g.. 2x) 
is stipulated for component 34. Three viewing zones are 
created. Zone KR1 is drawn so as to include the fields 
of view 45, 46 and 49 of components 31 . 32 and 35. Zone 
KR2 includes the fields of view 47. 50 and 51 of compo- 
nents 33. 36 and 37. Zone KR3 is drawn around the field 
of view 48 for component 34. 

Fig. 9 illustrates a procedure by which control unit 
22 compiles the library data. Generally, the library data 
are compiled by creating initialization data for a general 
set of components that are currently available. At the 
start of the compiling procedure, control unit 22 controls 
every part of the device, operates imaging unit 2 and light 
unit 3 and adjusts the conditions for imaging and for data 
processing. An initial menu screen then appears on mon- 
itor 6. In step 1 of the procedure, the operator uses key- 
board 14 to select the operation of compiling library data 
from the initial menu. This causes the contents of file 28, 
which stores product numbers in memory 23, to be dis- 
played on monitor 6. Fig. 10A shows an example of a 
screen that might be displayed on monitor 6 at this time. 
Table 36, which gives the class of each component is 
displayed, as are keys 37. which may be accessed using 
mouse 16 to verify selections. 

In step 2, the operator selects from the table 36 a 
given class of components (for example. A1). and table 
38 (see Fig. 10B), which shows all the variants in that 
class, is displayed. In step 3, the operator selects a given 
variant from the table, and the image of a reference sub- 
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strate that was previously placed on stage 5 is displayed 
on monitor 6 (step 4). 

The reference substrate is one on which the given 
component has been correctly soldered to achieve a 
mounting of acceptable quality. The operator determines s 
a location to be imaged which corresponds to a compo- 
nent that is the selected variant of the selected class. 
Using the image of this component, the operator defines 
an inspection region and a pointer, and uses keyboard 
14 to enter a desired magnification (step 5). Based on 10 
this information, control unit 22 compiles library data 
(step 6). 7 

When the processing has been executed for every 
variant (step 7) of every class (step 8) of component in 
the table 36, the control unit 22 combines the data stored is 
for each component and stores them in the library data 
file 27 (step 9). To compile the library data, control unit 
22 places in memory 23 data representing the shape of 
each component, and reference data created by another 
terminal device and obtained via floppy cfisk drive 21. 20 
These data may be amended as needed, and appropri- 
ate data may be added or corrected during use. 

Rg. 1 1 shows the procedure used in the initialization 
process mentioned above. First, the inspector selects ini- 
tialization mode from the initial menu screen. The file 25 
names of the various CAD data files stored in the mem- 
ory 23 are displayed on monitor 6. The inspector selects 
from this menu the data file for the substrate to be initial- 
ized. Control unit 22 reads out the appropriate CAD data 
file 26 and sets up a work area in memory 23 (step 1 ) 30 

In step 2, control unit 22 uses the part number in the 
CAD data to look up the data file 28 that corresponds to 
that number. Control unit 22 then specifies the class and 
variant identity of each component on the substrate that 
is being initialized. ^ 

In step 3, control unit 22 reads out of the file 27 the 
library data for every component on the substrate Con- 
trol unit 22 then links the library data for a given compo- 
nent with the CAD data for that component to create a 
data set defining a field of view, a pointer and a magnifi- 40 
cation for every component on the substrate. Control unit 
22 stores these data sets in the inspection data file 29 
(step 4). 

In step 5, control unit 22 defines and scans an imag- 
ing region in the structural dataforthe substrate obtained 45 
from the CAD data. This imaging region, which conforms 
to thef leld of view and a specified magnification of imag- 
ing unit 2, is based on data specifying the field of view in 
the file 29. Control unit 22 checks the fields of view con- 
tained in the imaging region at every scanning position so 
and identifies the location of the imaging region. 

The data associated with defining the imaging 
region at every positioning point (the location of the 
region, its size, the magnification to be used, and so on) 
are stored as data defining a viewing zone in inspection 55 
datafile30. The data defining a field of view and a pointer 
for each component, which are stored in inspection data 
file 29, are grouped for all components found in a single 



viewing zone. The data are associated with the data 
defining the inspection region and stored in data file 30. 

Fig. 12 shows details of the procedure that is exe- 
cuted in step 5 of the procedure illustrated in Fig. 1 1 . In 
step 5-1, the initial magnification is set. Control unit 22 
sets the magnification F at an initial value (e.g., 1x). In 
step 5-2, an imaging region corresponding to the mag- 
nification is created and a starting point for scanning is 
selected. Control unit 22 uses the lower left-hand corner 
of the region as a reference point For this reference point 
(Xg, Ys), control unit 22 writes the coordinates (1, 1) of 
the lower left-hand comer of the substrate. Control unit 
22 checks this region for the center point of a component 
for which the magnification has been specified as 1x 
(step 5-3). 

If a center point of a component having the appro- 
priate desired magnification is not present in the region, 
control unit 22 determines in step 5-7 whether the right 
border of the imaging region coincides with the right 
edge of the substrate and in step 5-9 whether the upper 
border of the imaging region coincides with the upper 
edge of the substrate. If either of those conditions is true, 
the control unit 22 changes in step 5-8 or 5-1 0 the coor- 
dinates of the reference point to those of the next posi- 
tion, and repeats execution of the determination 
processing in the step 5-3. 

When the scan reaches a location where the center 
point of a component to be viewed at a magnification of 
1x is contained in the region, control unit 22 uses this 
component as a reference and adjusts the imaging 
region so that it includes a number of fields of view for 
components with the same magnification value (step 5- 
4). 

Figs. 13A-13D illustrate an example of how the 
imaging region is adjusted. Three imaging regions (sr 1( 
sr 2 and sr 3 ) for components to be viewed at magnification 
F (e.g., 1x) are found in the same region. In the drawing. 
Pi, p 2 and p 3 are the center points of those components 
and R is the imaging region. 

In Fig. 1 3A, the center point p 1 of the first component 
has been found in imaging region R. Control unit 22 
adjusts the location of imaging region R so that the left 
boundary of field s^ is superimposed on the left bound- 
ary of imaging region R (Fig. 13B). Control unit 22 then 
moves imaging region R until the lower boundary of field 
sr! is superimposed on the lower boundary of imaging 
region R (Fig. 13C). w 

At this point, the fields of view for the two other com- 
ponents (sr 2 and sr 3 ) are both within imaging region R 
Control unit 22 then adjusts the location of imaging 
region R slightly and executes the final processing to 
define its location (Fig. 13D). 

Fig. 14 illustrates the process by which the final loca- 
tion of the imaging region R shown in Fig. 13D is defined 
Control unit 22 first checks the X and Y coordinates of 
the highest point in each of sr 1( sr 2 and sr 3 . Control unit 
22 then extracts from these data the minimum values 
Xmin. Ymin and the maximum values x max , y max . 
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Next, control unit 22 calculates the coordinates (X, 
Y) of the center point P of the rectangular area SR deter- 
mined by the coordinates x,™, y mm and x max , y max as: 

Control unit 22 then moves imaging region R so that its 
center point O is superimposed on center point P. The 
location of the final imaging region R is then determined 
as shown in Fig. 13D. 

Referring again to Fig. 1 2, when the location of imag- 
ing region R is determined as discussed above, control 
unit 22 extracts, in step 5-5, each component having an 
entire field of view that lies within the imaging region (and 
for which the magnification value F has been stipulated). 
Control unit 22 verifies the location of the imaging region 
at this time and its magnification F t links these data with 
the data representing the field of view and the pointer for 
each component which was extracted in step 5-5 above, 
and stores the combined data in inspection data file 30 
(step 5-6). 

If regions on the substrate which have not been proc- 
essed remain when the processing in step 5-6 has been 
completed, the location of the reference point is changed 
in step 5-8 or 5-10. and the imaging region is moved to 
the next scanning position. The processing is repeated 
to produce multiple viewing zones. When the entire 
imaging region has been scanned at the magnification F 
(i.e.. the result of steps 5-7 and 5-9 are both "no"), control 
unit 22 proceeds to step 5-1 1 and checks whether there 
are any components on the substrate for which another 
magnification has been stipulated. If so, control unit 22 
changes the magnification F in step 5- 1 2, returns to step 
5-2, and repeats the processing described above. Con- 
trol unit 22 repeats this process for each specified mag- 
nification level until the data defining the field of view at 
every magnification and the data for every component 
found in every viewing zone has been stored in inspec- 
tion data file 30. 

Figs. 15 and 1 6 show the inspection procedure exe- 
cuted after the checking procedure has been completed. 
In step 1 , the inspector selects the name of the substrate 
that is to be inspected. Thereafter, the data defining the 
viewing zones are read out of the inspection data file 30 
and sent to control unit 22 (step 2). 

In step 3, the inspector places the substrate to be 
inspected on stage 5 and gives a start command. Control 
unit 22 controls X-axis table 20 and Y-axis table 8 to f ind 
the first viewing zone on the substrate. Using this viewing 
zone, control unit 22 determines the field of view for 
imaging unit 2 and causes imaging to commence. This 
results in display of the image data for the first viewing 
zone on monitor 6 (step 4). 

Fig. 1 7 shows an example of an image displayed on 
monitor 6 when the location of viewing zone KR1 shown 
in Fig. 8 has been found by imaging unit 2. Based on the 
pointer data, a pointer P is displayed in every inspection 
region of corrponents 31 , 32 and 35, the components 
whose entire fields of view lie within zone KR1 . Pointers 



are not displayed for component 33, whose field of view 
lies only partially in this viewing zone, and component 
34. for which a different magnification has been stipu- 
lated. At this time, the magnification to which imaging unit 

5 2 is adjusted is displayed in a display unit 42 positioned 
in the upper right-hand corner of the screen. 

Fig. 1 8 shows an alternative example of an image 
displayed on monitor 6. In this example, corrponents 31 , 
32 and 35 are displayed just as they were in Fig. 1 7. but 

w components 33 and 34 are not. Components which do 
not lie entirely in the viewing zone (i.e., component 33). 
and components for which a different magnification has 
been specified (i.e.. component 34). are omitted from the 
display. Instead, the portions of the screen which corre- 

15 spond to the fields of view of those components, areas 
40 and 41. are displayed at a uniform density (e.g., as 
black regions). 

Referring again to Fig. 15, in step 5. the inspector 
enters a command to start inspecting the displayed view- 

20 ing zone. Control unit 22 displays only the pointers for 
the portions to be inspected in the first inspection region 
in this zone (step 6). Using these pointers, the inspector 
verifies the identity of the first portion to be inspected, 
performs a visual inspection of it. and. if its quality is 

25 acceptable, enters via keyboard 15a command to trans- 
mit the result. If there are other inspection regions in this 
viewing zone (so that steps 7 and 10 result in "no"), the 
procedure returns to step 6 and control unit 22 displays 
the pointers for the next inspection region. 

30 If the soldering of the portion being inspected is 
defective (so that the answer in step 7 is "yes"), the 
inspector enters data to indicate a defect via keyboard 
14 or 15 (step 8). These data are stored in memory 23 
along with the data representing the inspection region 

35 and the pointer (step 9). 

The same procedure is executed successively on 
every inspection region in the first viewing zone. When 
a quality judgment is rendered for the last place to be 
inspected in this zone, the answer in step 10 is "yes". If 

40 the same magnification has been stipulated for the next 
viewing zone, the answer in step 1 1 is "no" and that in 
step 12 is "yes". Proceeding to step 15, control unit 22 
transmits a command to XY table controller 25 to position 
the field of view of imaging unit 2 on the second viewing 

45 zone. 

In this way, image data are collected for every com- 
ponent in this zone for which this magnification has been 
stipulated. When every region has been inspected, con- 
trol unit 22 causes monitor 6 to display a message indi- 
so eating that the magnification should be changed (step 
13). 

Fig. 19 shows an example of the message which 
might be displayed when viewing zone KR2 in Fig. 8 
above has been inspected. Message box 43 is displayed 
55 over the image data in zone KR2. The inspector changes 
the magnification of imaging unit 2 in response to the 
message and executes verification processing using 
keyboard 14 or 15 or mouse 16. Now the answer in step 
14 is "yes", and control unit 22 proceeds to step 15. 
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where ,mage data for the first viewing zone is captured 
at the new magnification. In this example, the magnifica- 

^ n ti^i ed manua " y - ,tcou| d also be changed auto- 
mafacally if the imaging system in imaging unit 2 had an 

eiectncally operated zoom lens and control unit 22 were * 
conjured so as to be able to read the current magnifi- 

When all viewing zones created on the substrate 
have been inspected, the answer in step 11 is "yes" At 
Miispornt. control unit 22 reads from memory 23 all defect 10 
data for the substrate and displays them on monitor 6 
(step 1 7) In response, the inspector removes from stage 
5 the substrate that has just been inspected, places a 
new substrate on the stage (step 3). and proceeds to 
inspect it 

Whendefectdataforanentiresetof substrates have " 
been stored in memory 23. the inspector can entera data 
store command via input unit 7. This causes the defect 
data for every substrate in that lot to be stored on a floppy 
disk (steps 18 and 19). This floppy disk can be read by bo 
a device to correct the soldering, and the data can be 
used to repair all the defective spots on the substrate 
When the inspector enters a calculate command via 
input unit 7 the defect data for every substrate in the lot 
win be used to execute various calculations useful for es 
analyzing quality, including summing and statistical oper- 
anons. 

The field of view has been described as a rectangu- 
lar area encompassing all of theinspection regions, each 
of which contains a single component. However, it would so 

be equally acceptable todefine afield of view containing 
only some of the inspection regions. Likewise, instead of 
procuring the data identifying the class and location of 
every component from the CAD data, these data could 
be entered manually through input unit 7. 35 

H«J£L m K 6th0d for establishi "9 viewing zones 
descnbed above can also be used in automatic inspec- 
tion dev.ces. In this case, data associated with feature 

hSf' 1 T! 96 d3ta in each ""Pec** region could 
be stored as library data along with the sorts of data dis- 40 

£££ ? S W0U ' d substant ««y 'educe the ini- 

tiation tome. In addition, a viewing zone could be 
defined during initialization by using an imaging region 
based on a standard magnification (e.g.. 1x). For each 

he held of v,ew and magnification for each component 
. wou,d be ""Ked to data identifying the zone 
and stored in inspection data ffle 30. To inspect a sub- 
stoate, the .mage data for each viewing zone would be 

eS^fh * ^ ** ma9nificafon * '-"aging so 
each spot to be inspected could be changed automato- 

The example provided in the above explanation is a 
^" to '" Sp f Ct K the mo "nti"9 of components on a 
pnrrted substrate by generating data to establish viewing 5S 
zones. However, the invention is not limited to such 

'ST 6, ^^P" 031316 to any device generates 
J£?h «PWtai to be supplied to an inspec- 

tion device configured as described herein 



Fig. 20 is a perspective drawing of a machine for 
generating inspection data, and Fig. 21 shows the elec- 
trical configuration of the machine. Machine 60 includes 
control device 61. monitor 62 and input unit 65. which 
comprises keyboard 63 and mouse 64. Control device 
61 includes control unit 66 (a microcomputer), memory 
67 and floppy disk drive 68. 

Memory 67 stores the CAD data file 26. library data 
ffle 27 data file 28 for part number data and inspection 
data files 29 and 30. Control unit 66 executes the proce- 
dure shown in steps 1 through 4 of Fig. 1 1 above, links 
the CAD data in CAD data file 26 for the substrate being 
initialized with library data for the part number and class 
of toe component which are based on these CAD data 
and creates data to represent the field of view, pointers' 
and a magnification for every component on the sub- 
strate Control unit 66 stores these data in inspection 
data file 29. 

Control unit 66 uses the stored data to execute step 
5 in F.g. 1 1 above (i.e.. the procedure given in Fig. 12) 
Control unit 66 creates inspection data for which a cor- 
respondence is drawn between data setting up a number 
of viewing zones on the substrate and data defining a 
field of view and pointers for the components which lie 
in each zone. Control unit 66 stores this data in data file 
30. 

Once the creation of inspection data is completed 
control unit 66 transmits the inspection data (stored in* 
data ffle 30) to afloppy disk that has been loaded in disk 
drive 58. When this floppy disk is loaded in floppy disk 
drive 21 in the inspection device pictured in Fig 1 and 
read, the inspection data can be transmitted to memory 
23 in the control device 4 and the substrate can be 
inspected at once. The machine 60 can be connected to 
an inspection device, and it can be configured so as to 
be able to transmit inspection data. 

Other embodiments are within the following claims. 

Claims 

1 . A method of establishing a number of viewing zones 
to be used to inspect the attachment of a number of 
components arranged on the surface of an object 
comprising: ' 

establishing a field of view for at least one 
class of components; 

combining, for a component on the object 
data representing the location of that component on 
the object with data concerning a field of view pre- 
viously established for a class of component to 
which that component belongs; and 

creating at least one viewing zone on the sur- 
face of the object using the combined data for the 
component on the object 

• The method of claim 1 . further comprising establish- 
ing a magnification level for the at least one class of 
components, and wherein the step of combining 
comprises combining, for the component on the 
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object, data representing the location of that compo- 
nent on the object with data concerning a field of 
view and a magnification level previously estab- 
lished for the class of component to which that com- 
ponent belongs. 

3- A device for establishing a number of viewing zones 
to be used to inspect the attachment of a number of 
components arranged on the surface of an object, 
comprising: 

a memory storing a field of view for at least 
one class of components; 

an input device operable to supply, for a com- 
ponent on the object data representing a location of 
the component and a class of components to which 
the component belongs; and 

a controller operable to combine, for the com- 
ponent on the object, data from the input device rep- 
resenting the location of the component on the 
object with data from the memory concerning a field 
of view for a class of component to which the com- 
ponent belongs, and to create at least one viewing 
zone on the surface of the object using the combined 
data for the component on the object. 

4. The device of claim 3 , wherein the input device uses 
design data created to arrange the component on 
the object to supply data representing a location of 
the component and a class of components to which 
the component belongs. 

5. The device of claim 3, wherein a viewing zone 
includes data representing multiple components on 
the object and wherein the controller adjusts a posi- 
tion of the viewing zone so that a center point of the 
viewing zone matches a center point of a rectangular 
region that encompasses the fields of view of all 
components included in the viewing zone. 

6. The device of claim 3, wherein the memory stores a 
field of view and a magnification level for the at least 
one class of components, and wherein the controller 
is operable to combine, for the component on the 
object, data from the input device representing the 
location of the component on the object with data 
from the memory concerning the field of view and 
the magnification level for a class of component to 
which the component belongs. 

7. The device of claim 6, wherein the input device uses 
design data created to arrange the component on 
the object to suppty data representing a location of 
the component and a class of components to which 
the component belongs. 

8. The device of claim 6, wherein a viewing zone 
includes data representing multiple components on 
the object and wherein the controller adjusts a posi- 
tion of the viewing zone so that a center point of the 



viewing zone matches a center point of a rectangular 
region that encompasses the fields of view of all 
components included in the viewing zone. 

5 9. A device for establishing a number of viewing zones 
to be used to inspect the attachment of a number of 
components arranged on the surface of an object, 
comprising: 

a memory storing a field of view for at least 

w one class of components and a table of correspond- 
ences that identifies a component on the object and 
provides data representing a class of components 
to which the component belongs; 

an input device operable to supply, for the 

is component on the object, data representing a loca- 
tion of the component; and 

a controller operable to use the table of cor- 
respondences to identify the class of components to 
which the component on the object belongs, to com- 

20 bine data from the input device representing the 
location of the component on the object with data 
from the memory concerning a field of view for the 
identified class of component to which the compo- 
nent belongs, and to create at least one viewing 

25 zone on the surface of the object using the combined 
data for the component on the object. 

1 0. The device of claim 9. wherein the input device uses 
design data created to arrange the component on 

30 the object to supply data identifying a component 
and representing a location of the component. 

11. The device of claim 9, wherein a viewing zone 
includes data representing multiple components on 

35 the object and wherein the controller adjusts a posi- 
tion of the viewing zone so that a center point of the 
viewing zone matches a center point of a rectangular 
region that encompasses the fields of view of all 
components included in the viewing zone. 

40 

12. The device of claim 9, wherein the memory stores a 
field of view and a magnification level for the at least 
one class of components, and wherein the controller 
is operable to combine, for the component on the 

45 object, data from the input device representing the 
location of the component on the object with data 
from the memory concerning the field of view and 
the magnification level for a class of component- to 
which the component belongs. 

50 

13. The device of claim 12. wherein the input device 
uses design data created to arrange the component 
on the object to supply data representing a location 
of the component and a class of components to 

55 which the component belongs. 

14. The device of claim 12. wherein a viewing zone 
includes data representing multiple components on 
the object and wherein the controller adjusts a posi- 
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ton of the viewing zone so that a center point of the 
viewing zone matches a centerpoint of a rectangular 
region that encompasses the fields of view of all 
components included in the viewing zone. 

15. A method of inspecting the appearance of an object * 
on whose surface are arranged a number of compo- 
nents, comprising: 

establishing a field of view for at least one 
class of components; 10 

combining, for a component on the object 
data representing the location of that component ori 
the object with data concerning a field of view pre- 
viously established for a class of component to 
which that component belongs; 1S 

creating at least one viewing zone on the sur- 
face of the object using the combined data lor the 
component on the object; 

capturing image data representative of por- 
tions of the object in the viewing zones; and so 

analyzing the image data to determine 
whether components in a viewing zone are orooerlv 
attached to the object. P° P eriy 

16. The method of claim 15. further comprising estab- ss 
lishing a magnification level for the at least one class 
of components, wherein the step of combining com- 
prises combining, for the component on the object 
data representing the location of that component on 
the object with data concerning a field of view and a 30 
magnification level previously established for the 
class of component to which that component 
belongs, and wherein the step of capturing the 
'mage data comprises capturing the image data 
using a magnification level associated with a com- as 
ponent located in the viewing zone. 

17. A device for inspecting the appearance of an object 
on whose surface are arranged a number of compo- 
nents, comprising: 

an imaging device operable to capture an 
image of a portion of the object; 

a memory storing a field of view for at least 
one class of components; 

an input device operable to supply, for a com- 4s 
ponent on the object, data representing a location of 
the component and a class of components to which 
the component belongs; and 

a controller operable to combine, for the com- 
ponent on the object, data from the input device rep- so 
resenting the location of the component on the 
object with data from the memory concerning a field 
of view for a class of component to which the com- 
ponent belongs, to create at least one viewing zone 
on the surface of the object using the combined data ss 
for the component on the object, to control a position 
of the imaging device, and to cause the imaging 
device to successively capture data for each viewing 
zone. 



18. The device of claim 17. wherein the input device 
uses design data created to arrange the component 
on the object to supply data representing a location 
of the component and a class of components to 
which the component belongs. 

19. The device of claim 17. wherein a viewing zone 
includes data representing multiple components on 
the object and wherein the controller adjusts a posi- 
tion of the viewing zone so that a center point of the 
viewing zone matches a center point of a rectangular 
region that encompasses the fields of view of all 
components included in the viewing zone 

20. The device of claim 17. wherein the memory stores 
a field of view and a magnification level for the at 
least one dass of components, and wherein the con- 
troller is operable to combine, for the component on 
the object, data from the input device representing 
the location of the component on the object with data 
from the memory concerning the field of view and 
the magnification level for a class of component to 
which the component belongs. 

21. The device of claim 20. wheran the input device 
uses design data created to arrange the component 
on the object to supply data representing a location 
of the component and a class of components to 
which the component belongs. 

22. The device of claim 20. wherein a viewing zone 
includes data representing multiple components on 
toe object and wherein the controller adjusts a posi- 
tion of the viewing zone so that a center point of the 
viewing zone matches a center point of a rectangular 
region that encompasses the fields of view of all 
components included in the viewing zone 



23. A device for inspecting the appearance of an object 
on whose surface are arranged a number of compo- 
nents, comprising: 

an imaging device operable to capture an 
image of a portion of the object; 

a memory storing a field of view for at least 
one class of components and a table of correspond- 
ences that identifies a component on the object and 
provides data representing a class of components 
to which the component belongs; 

an input device operable to supply, for the 
component on the object, data representing a loca- 
tion of the component: and 

a controller operable to use the table of cor- 
respondences to identify the class of components to 
which the component on the object belongs, to com- 
bine data from the input device representing the 
location of the component on the object with data 
from the memory concerning a field of view for the 
identified class of component to which the compo- 
nent belongs, to create at least one viewing zone on 
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the surface of the object using the combined data 
for the component on the object, to control a position 
of the imaging device, and to cause the imaging 
device to successively capture data for each viewing 
zone using a magnification level associated with a 5 
component located in the viewing zone. 

24. The device of claim 23, wherein the input device 
uses design data created to arrange the component 

on the object to supply data representing a location 10 
of the component and a class of components to 
which the component belongs. 

25. The device of claim 23, wherein a viewing zone 
includes data representing multiple components on 15 
the object and wherein the controller adjusts a posi- 
tion of the viewing zone so that a center point of the 
viewing zone matches a center point of a rectangular 
region that encompasses the fields of view of all 
components included in the viewing zone. 20 

26. The device of claim 23, wherein the memory stores 
a field of view and a magnification level for the at 
least one class of components, and wherein the con- 
troller is operable to combine, for the component on 25 
the object, data from the input device representing 
the location of the component on the object with data 
from the memory concerning the field of view and 
the magnification level for a class of component to 
which the component belongs. 30 

27. The device of claim 26, wherein the input device 
uses design data created to arrange the component 
on the object to supply data representing a location 

of the component and a class of components to 35 
which the component belongs. 

28. The device of claim 26, wherein a viewing zone 
includes data representing multiple components on 
the object and wherein the controller adjusts a posi- 40 
tion of the viewing zone so that a center point of the 
viewing zone matches a center point of a rectangular 
region that encompasses the fields of view of all 
components included in the viewing zone. 

45 

29. A device for inspecting the appearance of an object 
on whose surface are arranged a number of compo- 
nents, comprising: 

an imaging device operable to capture an 
image of a portion of the object; so 

a memory storing a field of. view for at least 
one class of components; 

an input device operable to supply, for a com- 
ponent on the object, data representing a location of 
the component and a class of components to which 55 
the component belongs; 

a controller operable to combine, for the com- 
ponent on the object, data from the input device rep- 
resenting the location of the component on the 



object with data from the memory concerning a field 
of view for a class of component to which the com- 
ponent belongs, to create at least one viewing zone 
on the surface of the object using the combined data 
for the component on the object to control a position 
of the imaging device, and to cause the imaging 
device to successively capture data for each viewing 
zone; and 

a display device operable to synthesize and 
display on the image data for each viewing zone sep- 
arate image data indicative of the locations to be 
inspected in that viewing zone. 

30. The device of claim 29, wherein the locations to be 
inspected in a viewing zone correspond only to com- 
ponents for which the entire fields of view of the com- 
ponents are contained in the viewing zone. 

31. The device of claim 29, wherein the display device 
superimposes on the image data for each viewing 
zone the image data to indicate the portions to be 
inspected on each component whose entire f ield of 
view lies in that viewing zone and displays a portion 
of the image representing a component having a 
field of view that is only partly contained within a 
viewing zone using a different set of image data to 
indicate which portions of it are to be inspected. 

32. The device of claim 31 . wherein the display device 
displays at a uniform density the portion of the image 
representing a component having a field of view that 
is only partly contained in a viewing zone. 

33. The device of daim 29, wherein the memory stores 
a field of view and a magnification level for the at 
least one class of components, and wherein the con- 
troller is operable to combine, for the component on 
the object, data from the input device representing 
the location of the component on the object with data 
from the memory concerning the field of view and 
the magnification level for a class of component to 
which the component belongs. 

34. The device of claim 33, wherein the locations to be 
inspected in a viewing zone correspond only to com- 
ponents for which the entire fields of view of the com- 
ponents are contained in the viewing zone. 

35. The device of claim 33, wherein the display device 
superimposes on the image data for each viewing 
zone the image data to indicate the portions to be 
inspected on each component whose entire field of 
view lies in that viewing zone and displays a portion 
of the image representing a component having a 
field of view that is only partly contained within a 
viewing zone using a different set of image data to 
indicate which portions of it are to be inspected. 
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The device of claim 35. wherein the display device 
displays at a uniform density the portion of the image 
representing a corrponent having a field of view that 
is only partly contained in a viewing zone. 
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